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(54) Title: 



MHTHOD AND APPARAT US FOR USING DISPLAY DEVICE AND DISPLAY CONDITION INFORMATION 



(57) Abstract 

The present invention relates to methods (figure 10, element 
700) and apparatus for increasing the perceived quality of displayed 
images. This is achieved in a variety of ways including the use of a 
plurality of device specific display characteristics (figure 10. e ement 
715) when preparing images for display (figure 10. element 704). 
It is also achieved through the monitoring of display device and/or 
ambient light conditions, e.g.. on a periodic basis, and using the 
obtained information when controlling a display output. Another 
approach to improving the perceived quality of displayed images 
involves the use of information (figure 10. element 352) relating 
to a specific user's ability to perceive image characteristics i such as 
color. By customizing display output (figure 10, element 718) to an 
individual user's own physical perception capabilities and/or viewing 
i characteristics (figure 10, element 352) it is possible to enhance the 
image quality perceived by the individual viewer as compared to 
I embodiments which do not take into consideration ind.vidual user 
characteristics. 
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METHOD AND APPARATUS FOR USING DISPLAY DEVICE AND DISPLAY CONDITION 
INFORMATION 



FTFT D OF THF TNVENTION 
5 The present invention relates to methods and apparatus for displaying images, 

and more particularly, to methods and apparatus for increasing the perceived quality 
of displayed images. 

RArKGRQUNn rff THF. TNVENTION 

Color display devices have become the principal display devices of choice for 
10 most computer users. The display of color on a monitor is normally achieved by 

operating the display device to emit light, e.g., a combination of red, green, and blue 

light, which results in one or more colors being perceived by a human viewer. 

In cathode ray tube (CRT) display devices, the different colors of light are 

generated via the use of phosphor coatings which may be applied as dots in a 
15 sequence on the screen of the CRT. A different phosphor coating is normally used to 

generate each of the three colors, red, green, and blue resulting in repeating sequences 

of phosphor dots which, when excited by a beam of electrons will generate the colors 

red, green and blue. 

As CRTs age, the light output intensity tends to decrease for a given input 
20 Intensity. Thus, older computer CRT display devices tend to be more difficult to read 
than new CRTs. 

The term pixel is commonly used to refer to one spot in, e.g., a rectangular 
grid of thousands of such spots. The spots are individually used by a computer to 
form an image on the display device. For a color CRT, where a single triad of red, 

25 green and blue phosphor dots cannot be addressed, the smallest possible pixel size 
will depend on the focus, alignment and bandwidth of the electron guns used to excite 
the phosphors. The light emitted from one or more triads of red, green and blue 
phosphor dots, in various arrangements known for CRT displays, tend to blend 
together giving, at a distance, the appearance of a single colored light source. 

30 In color displays, the intensity of the light emitted corresponding to the 

additive primary colors, red, green and blue, can be varied to get the appearance of 
almost any desired color pixel. Adding no color, i.e., emitting no light, produces a 



WO 00/45365 



PCT/US00/02169 



black pixel. 

Adding 100 percent of all three colors results in white. 

Liquid crystal displays (LCDs), or other flat panel display devices are 
commonly used in portable computer devices in the place of CRTs. This is because 
5 flat panel displays tend to be small and lightweight in comparison to CRT displays. 
In addition, flat panel displays tend to consume less power than comparable sized 
CRT displays making them better suited for battery powered applications than CRT 
displays. 

As the quality of flat panel color displays continues to increase and their cost 

10 decreases, flat panel displays are beginning to replace CRT displays in desktop 
applications. Accordingly, flat panel displays, and LCDs in particular, are becoming 
ever more common. 

Color LCD displays are exemplary of display devices which utilize multiple 
distinctly addressable elements, referred to herein as pixel sub-elements or . pixel sub- 

15 components, to represent each pixel of an image being displayed. In displays 
commonly used for computer applications, each pixel on a color LCD display usually 
comprises three non-square elements, i.e., red, green and blue (RGB) pixel sub- 
components. Thus, in such systems, a set of RGB pixel sub-components together 
make up a single pixel. LCD displays of this type comprise a series of RGB pixel 

20 sub-components which are commonly arranged to form stripes along the display. The 
RGB stripes normally run the entire length of the display in one direction. The 
resulting RGB stripes are sometimes referred to as "RGB striping". Common LCD 
monitors used for computer applications, which are wider than they are tall, tend to 
have RGB stripes running in the vertical direction. While RGB striping is common, 

25 R, G, B pixel sub-components of different rows may be staggered or off set so that 
they do not form stripes. 

Other LCD pixel sub-component display patterns are also possible. For 
example, in some devices, each color pixel includes four square pixel sub- 
components. 

30 While LCD devices offer some advantages over CRT display devices in terms 

of power consumption and weight, the perceived quality of LCD displays can be 
significantly impacted by viewing angle. The amount and color of light incident on 



WO 00/45365 



PCT/US00/02169 



an LCD device can also have a major impact on the perceived quality of images 
displayed on the LCD device. In addition, LCDs tend to have response characteristics 
which can vary widely from display to display and even among the same model 
displays made by the same manufacturer. 
5 Perceived image quality of a display device depends not only on the physical 

characteristics of the display device, but also on the viewer's ability to perceive such 
characteristics. For example, a viewer with a greater sensitivity to one color will 
perceive an image differently than a viewer with a greater sensitivity to another color. 
Viewers without the ability to perceive color at all are likely to perceive the quality of 
10 a color image somewhat differently than a viewer who can appreciate the supplied 
color information. 

In view of the above, it is clear that physical display device characteristics, 
viewing conditions, e.g., ambient light, and a user's ability to perceive various image 
characteristics all have an effect on the perceived quality of an image. 

1 5 Given the quality of current display devices, it is apparent that for many 

applications improvements in image quality are not only desirable but also important 
to insure a user's accurate interpretation of displayed images. 

In view of the above, it is apparent that there is a need for new and improved 
methods and apparatus for displaying images such as text and graphics. It is desirable 

20 that at least some of the new methods and apparatus be capable of being used with 
both CRT as well as LCD display devices. Furthermore, in order to enhance the 
quality of images for specific viewers it is desirable that at least some display methods 
take into consideration how specific users perceive the images being displayed to 
them. 

25 SUMMARY OF THE PRESENT INVENTION 

The present invention relates to methods and apparatus for increasing the 
perceived quality of displayed images. This is achieved in a variety of ways including 
the use of a plurality of device specific display characteristics and/or user preference 
or perception information when preparing images for display. The display device 
30 information (DDI) may be stored in what is referred to as a display device profile 
(DDP). User preference and/or perception information is stored in a user profile. 

In accordance with one feature of the present invention display device output 
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characteristics and/or ambient light conditions are monitored, e.g., on a periodic basis. 
The information obtained from the monitoring operation is used to update the DDP 
for the monitored display device. The information in the DDP is then used when 
generating an image for display. 

Using information relating to a specific user's viewing preferences and/or 
ability to perceive image characteristics such as color also improves the perceived 
quality of displayed images. By customizing display output to an individual user's 
own physical perception capabilities and/or viewing characteristics it is possible to 
enhance the image quality perceived by the individual viewer as compared to 
embodiments which do not take into consideration individual user characteristics. 

Display device information used in accordance with the present invention may 
be stored in a display device profile. This profile may be provided by the device 
manufacturer and loaded onto a computer system other device at the time the system 
is configured for with the display. Alternatively, the information may stored in the 
display device and supplied to a system coupled thereto in response to a request for 
display device information. Yet another alternative is to maintain a database of 
display device information or use be including information on a plurality of different 
display devices. The database may be maintained as part of the operating system. 
Device specific information is retrieved therefrom when a particular display device is 
used or installed. 

The display device profile may include such information as the device's date 
of manufacture and the type of display. It may also include information on the 
display device's gamut, white point, gamma, pixel pattern, resolution, element shape 
and/or method of light modulation. The display device type may be CRT, reflective 
LCD, transmissive LCD, etc. The white point may be expressed in tristimulus values 
or R, G, B luminance values. Pixel pattern may be expressed in terms of the order or 
sequence of color pixel sub-components, e.g., RGB, BGR, RGGB, or any other 
implemented configuration. Display element shape information identifies, e.g., the 
shape of display pixels, e.g., square, rectangular, triangular or circular, and/or the 
shape of pixel sub-components which may also be square, rectangular, triangular or 
circular. The light modulation information indicates, e.g., whether color information 
is spatially or time modulated. In the case of spatial light modulation different color 
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light is displayed at different positions on the screen. In the case of time modulation, 
different colors of light are displayed on the same portion of the screen at different 
times. 

As discussed above, display device, e.g., profile information, may be 
periodically updated. This may be done by taking actual measurements of display 
device characteristics including light output. It may also be done by mathematically 
compensating for the age of the device and anticipated degradation in the device over 
time. In accordance with one feature of the invention, a display device's gamut, 
gamma and white point values are updated in the display device profile to reflect 
measured or estimated changes due to age or use. Display age information may be 
obtained by subtracting display device installation information maintained by the 
operating system from current date information also maintained by the operating 
system. Alternatively, it can be obtained using date of manufacture information 
included in the original display device profile. 

Ambient light conditions are measured, in accordance with one feature of the 
present invention, using the same device used to periodically measure display device 
light output characteristics. The ambient light condition information may include, 
e.g., information on whether a room light is on or off and/or information on the color 
components of the ambient light present. Ambient light condition information is used 
in an exemplary embodiment when controlling the display's light output. For 
example, information that the ambient light includes relatively more blue than red or 
green light, e.g!, due to the use of fluorescent lights, results in a controlled decrease in 
the relative intensity of blue light emitted by the display device. 

With regard to user perception and/or preference information, this information 
may include information on a specific user's ability to perceive color. Human color 
sensitivity can be measured by presenting the specific user with a simple test, e.g., 
displaying colors and then querying the user about his or her ability to perceive the 
displayed colors. The user perception information may also include user provided 
information on the user's viewing angle and/or position relative to the display screen. 
Information about a user's ability to perceive color and/or other perception 
information is stored in a user profile. The user profile can be maintained as part of 
the system's operating system. 
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The above discussed methods of improving the perceived quality of displayed 
images can be used individually or in combination. 

While the methods and apparatus of the present invention can be used to 
enhance the perceived image quality of most display devices, they are well suited for 
use with color flat panel display devices, e.g., LCD displays. In order to enhance the 
image quality of color LCD display devices, e.g., when rendering text, the luminous 
intensity of pixel sub-components can be independently controlled so that each pixel 
sub-component can be used to represent different portions of an image. While this 
technique of pixel sub-component control can provide a gain in effective resolution in 
one dimension, it can lead to color distortions which can be caused by the 
independent luminous intensity control of pixel sub-components. In such systems, 
color correction processing may be used to detect and reduce or eliminate what would 
be interpreted by most people as objectionable color distortions. Unfortunately, such 
color correction or compensation operations tend to reduce the benefit in terms of 
increased effective resolution that is provided by treating the different color pixel sub- 
components as independent luminance sources. 

In accordance with one feature of the present invention, color correction 
processing is implemented as a function of at least some of the above discussed 
display device information, ambient light condition information and/or user 
perception information. For example, color correction processing may be performed 
as a function of a display device's specific gamma values, detected ambient light 
conditions which will affect a human's ability to perceive color and/or the user's 
specific perception characteristics. For example, in the case of a color blind user, 
color compensation may automatically be disabled. In such a case, in LCD displays, 
an optimum or near optimum enhancement of image resolution may be achieved by 
treating pixel sub-components as independent luminance sources as opposed to a 
single luminance source. With color compensation disabled normally objectionable 
color distortions may exist in the displayed images. However, in the case of a color 
blind individual such distortions are not noticeable or objectionable and the increased 
effective resolution achieved by ignoring such color distortions is desirable. 

Additional features, embodiments and benefits of the methods and apparatus 
of the present invention are discussed in the detailed description which follows. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 illustrates a portable computer system implemented in accordance with 
one embodiment of the present invention. 

FIG. 2 illustrates a computer system, implemented in accordance with the 
present invention, in greater detail than FIG. 1 . 

FIG. 3 illustrates the relationship between various software and hardware 
elements of the present invention and the data flow there between. 

FIG. 4 illustrates displaced sampling performed in accordance with one 
embodiment of the present invention. 

FIG. 5 illustrates a user profile generation routine implemented in accordance 
with one embodiment of the present invention. 

FIG. 6 illustrates a first exemplary screen display used in generating a user 

profile. 

FIG. 7 illustrates a second exemplary screen display used in generating a user 

profile. 

FIG. 8 illustrates a third exemplary screen display used in generating a user 

profile. 

FIG. 9 illustrates an exemplary display device profile generation and updating 

routine. 

FIG. 10 illustrates the steps performed by an exemplary graphics display 
interface when rendering text in accordance with the present invention. 

"FIGs. 11 and 12 illustrate exemplary scaling operations performed in 
accordance with the present invention. 

FIGs. 13, 14, 15 and 16 illustrate hinting operations performed in accordance 
with the present invention. 

FIG. 17 illustrates a scan conversion sub-routine of the present invention. 

FIG. 18 illustrates anti-aliasing filters which may be used to implement a scan 
conversion operation in accordance with the present invention. 

FIG. 19 illustrates an exemplary scan conversion operation suitable for use 
when preparing images for display on horizontally striped display devices. 

FIG. 20 is an exemplary scan conversion operation suitable for use when 
preparing images for display on vertically striped display devices. 
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FIG. 21 illustrates a pixel color processing sub-routine suitable for performing 
color correction operations in accordance with the present invention. 

FIG. 22 illustrates routines used to implement a device driver in accordance 
with one embodiment of the present invention. 
5 FIG. 23, which comprises the combination of FIGs. 23A-23E, illustrates 

multiple sets of filter coefficients each of which can be used to perform an anti- 
aliasing filtering operation. 
DETAILED DESCRIPTION 

FIG. 1 illustrates a portable computer system 100, which comprises a housing 

10 101, a disk drive 105, keyboard 104 and a flat panel display 102. The display 102 is 

implemented as an LCD display device with vertical RGB striping. Each set of R, G, 
B pixel sub-components 110, 112 represent one pixel. While only two pixels 110, 
112 are shown, it is to be understood that the display 102 comprises many rows and 
columns of such pixels. The computer system 100 includes a light measuring device 

15 106 which is mounted using a hinge 108. The sensor 106 can be positioned in front of 

the display 102, as shown in FIG. 1, to measure the actual light output of the display 
102. Such measurements may be taken periodically, in accordance with the present 
invention, when data on the state of the display device 102 is to be measured and used 
for updating a display profile. During the measurement, a pre-selected test pattern 

20 may be displayed on the screen 102. 

When not being used to measure screen characteristics, the sensor 106 can be 
pivoted on the hinge 108 so that it is positioned in a direction facing away from, and 
not blocking, the display screen 102. In such a position, the sensor 106 can be used to 
measure ambient light conditions. 

25 FIG. 2 and the following discussion provide a brief, general description of an 

exemplary apparatus in which at least some aspects of the present invention may be 
implemented. Various methods of the present invention will be described in the 
general context of computer-executable instructions, e.g., program modules, being 
executed by a computer device such as a personal computer. Other aspects of the 

30 invention will be described in terms of physical hardware such as, e.g., display device 
components and display screens. 

The methods of the present invention may be affected by other apparatus than 
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the specific described computer devices. Program modules may include routines, 
programs, objects, components, data structures, etc. that perform task(s) or implement 
particular abstract data types. Moreover, those skilled in the art will appreciate that at 
least some aspects of the present invention may be practiced with other 
5 configurations, including hand-held devices, multiprocessor systems, microprocessor- 
based or programmable consumer electronics, network computers, minicomputers, set 
top boxes, mainframe computers, displays used in, e.g., automotive, aeronautical, 
industrial applications, and the like. At least some aspects of the present invention 
may also be practiced in distributed computing environments where tasks are 

10 performed by remote processing devices linked through a communications network. 
In a distributed computing environment, program modules, routines and data, e.g., 
device profiles and user profile information, may be located in local and/or remote 
memory storage devices. 

With reference to FIG. 2, an exemplary apparatus 200 for implementing at 

15 least some aspects of the present invention includes a general purpose computing 
device, e.g., a personal computer 220. The personal computer 220 may include a 
processing unit 221, a system memory 222, and a system bus 223 that couples various 
system components including the system memory to the processing unit 221. The 
system bus 223 may be any of several types of bus structures including a memory bus 

20 or memory controller, a peripheral bus, and a local bus using any of a variety of bus 
architectures. The system memory 222 may include read only memory (ROM) 224 
and/or random access memory (RAM) 225. A basic input/output system 226 (BIOS), 
including basic routines that help to transfer information between elements within the 
personal computer 220, such as during start-up, may be stored in ROM 224. The 

25 personal computer 500 may also include a hard disk drive 227 for reading from and 
writing to a hard disk, (not shown), a magnetic disk drive 228 for reading from or 
writing to a (e.g., removable) magnetic disk 229, and an optical disk drive 230 for 
reading from or writing to a removable (magneto) optical disk 23 1 such as a compact 
disk or other (magneto) optical media. The hard disk drive 227, magnetic disk drive 

30 228, and (magneto) optical disk drive 230 may be coupled with the system bus 223 by 
a hard disk drive interface 232, a magnetic disk drive interface 233, and a (magneto) 
optical drive interface 234, respectively. The drives and their associated storage 
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media provide nonvolatile storage of machine readable instructions, data structures, 
program modules and other data for the personal computer .220. Although the 
exemplary environment described herein employs a hard disk, a removable magnetic 
disk 229 and a removable optical disk 23 1, those skilled in the art will appreciate that 
5 other types of storage media, such as magnetic cassettes, flash memory cards, digital 
video disks, Bernoulli cartridges, random access memories (RAMs), read only 
memories (ROM), and the like, may be used instead of, or in addition to, the storage 
devices introduced above. The removable magnetic disk 229 can be used for storing a 
display device profile (DDP) provided by the manufacturer of display device 247. 

10 The DDP can be transferred from the disk 229 to the system memory 222 for use by 
the operating system 235. 

A number of program modules may be stored on the hard disk 223, magnetic 
disk 229, (magneto) optical disk 231, ROM 224 or RAM 225, such as an operating 
system 235, one or more application programs 236, other program modules 237, 

15 and/or program data 238 for example, A user may enter commands and information 
into the personal computer 220 through input devices, such as a keyboard 240 and 
pointing device 242 for example. Thus, a user can provide information via the 
available input devices regarding how the user perceives certain images, e.g., test 
images, and where the user is physically positioned relative to the display device 247 

20 in terms of viewing angle. In addition, the user may use the input devices to select a 
position for various control settings, e.g., sliders, intended to provide user display 
preference information, e.g. gamma values preferences and/or preference for color 
accuracy vs. resolution. 

Sensor 108 and other input devices (not shown) such as a microphone, 

25 joystick, game pad, satellite dish, scanner, or the like may also be included. These 
and other input devices are often connected to the processing unit 221 through a serial 
port interface 246 coupled to the system bus. However, input devices may be 
connected by other interfaces, such as a parallel port, a game port or a universal serial 
bus (USB). Liquid crystal display device 254 or another type of display device, e.g., a 

30 CRT display, may also be connected to the system bus 223 via an interface, such as a 
video adapter 248 for example. 

In the FIG. 2 embodiment, the display 254 includes display device profile 
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information stored within the display 254. This information can be communicated to 
and stored in the system memory 222, e.g., via video adapter 248 and system bus 223. 

In addition to the display 254, the personal computer 220 may include other 
peripheral output devices (not shown), such as speakers and printers for example. 

The personal computer 220 may operate in a networked environment which 
defines logical connections to one or more remote computers, such as a remote 
computer 249. The remote computer 249 may be another personal computer, a server, 
a router, a network PC, a peer device or other common network node, and may 
include many or all of the elements described above relative to the personal computer 
220, although only a memory storage device 250 has been illustrated in FIG. 2. The 
logical connections depicted in FIG. 2 include a local area network (LAN) 251 and a 
wide area network (WAN) 252, an intranet and the Internet. 

When used in a LAN, the personal computer 220 may be connected to the 
LAN 25 1 through a network interface adapter (or "NIC") 253. When used in a WAN, 
such as the Internet, the personal computer 220 may include a modem 254 or other 
means for establishing communications over the wide area network 252. Thus, the 
personal computer 220 may receive display device profile information from, e.g., a 
display manufacturer over the Internet or by modem. The modem 254, which may be 
internal or external, may be connected to the system bus 223 via the serial port 
interface 246. In a networked environment, at least some of the program modules 
depicted relative to the personal computer 220 may be stored in the remote memory 
storage device. The network connections shown are exemplary and other means of 
establishing a communications link between the computers may be used. 

FIG. 3 illustrates the relationship between various hardware and software 
components of the system 200 and the components of the system's operating system 
235. 

As illustrated, the operating system 235 of the system 200 includes a plurality 
of routines, e.g., a user profile generation routine 342 and a DDP updating routine 
344. The operating system 235 also includes additional components such as a 
graphics display interface 302, a device driver 371 and various data, e.g., display 
device information 345, user profiles 352, scan conversion filter coefficients 347 and 
color compensation filter values 349. As will be discussed further below, the graphics 
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display interface 302 and device driver 371 may each include one or more routines. 

The graphics display interface 302 in combination with the device driver 371 
is responsible for preparing text and/or graphics information for output to the display 
adapter 248 so that it can be displayed on the display device 254. The graphics 
display interface includes a type rasterizer 306 which is responsible for generating 
bitmap representations of images to be displayed from input information, e.g., text 
output information 337 received from application 236. The information received 
from application 236 may include, e.g., information identifying the text characters to 
be displayed, and the font and point size to be used when displaying the text 
characters. 

The type rasterizer 306 includes a set of high resolution digital representations 
of characters 305, and a set of rendering and rasterization routines 307. The digital 
representation of characters 305 may include font files which include scalable outline 
representations of characters and character spacing information. The character 
outlines may be expressed in the form of lines, points and/or curves. Portions of a 
character within a character outline represent foreground image areas while portions 
outside the character outlines, e.g., the area between characters, represent background 
image areas. 

The set of rendering and rasterization routines 307 includes scaling, hinting 
and scan conversion subroutines 308, 310, 312 as well as a color compensation sub- 
routine 370. The scaling, hinting and scan conversion sub-routines 308, 310, 312 and 
color compensation sub-routine 370 user display device and/or user profile 
information, as will be discussed in detail below, in accordance with the present 
invention. In this manner, quality of generated images can be maximized for a 
particular display device and/or user of the system 200. 

Scaling sub-routine 308 is responsible for scaling the outline representations 
of the characters to be rendered. This is done, in accordance with the present 
invention, as a function of pixel pattern and/or other display device information 
included in the display device profile corresponding to display 254 upon which the 
images are to be displayed. 

Hinting sub-routine 310 is responsible for adjusting the shape and/or position 
of character outlines. Hinting is performed as a function of display device 
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information, e.g., taking into consideration the position, shape, type and/or 
arrangement of pixel sub-components which comprise the display 254. Hinting may 
also take into consideration a user's ability to perceive color as expressed in terms of 
a user's sensitivity to color errors. In accordance with one embodiment of the present 
invention, hinting is performed to reduce color errors for users who have indicated a 
desire for color accuracy over resolution. For users who are not sensitive to color 
errors, e.g. color blind individuals, color accuracy is not an issue and the hinting is 
performed to maximize character shape and resolution without regard to the effect on 
an image's color. 

Scan conversion sub-routine 312 is responsible for generating a bitmap 
representation of an image from the hinted outline representation produced by the 
hinting sub-routine 312. The scan conversion operation involves sampling the hinted 
outline image representation, filtering the sampled image values, and generating 
therefrom red, green and blue pixel sub-component scan conversion output values. 
As will be discussed below, the scan conversion output values may be used as 
luminous intensity levels or as blend coefficients sometimes called alpha values. In 
accordance with the present invention, the portions of the image which are sampled, 
to generate the scan conversion output values for each of the red, green and blue pixel 
sub-components, are displaced- That is, different but potentially overlapping image 
portions are used to generate each pixel sub-component scan conversion output value. 

FIG. 4 illustrates a displaced sampling operation which may be performed as 
part of a scan conversion operation. In FIG. 4 block 420 represents an image which is 
to be sampled for scan conversion purposes. The nine square portions of the image 
420 correspond in size to the size of a displayed pixel. Accordingly, the image 420 
may be thought of as corresponding to three rows R(N), R(N+1) and R(N+2) and three 
columns C(N), C(N+1), C(N+2) of pixels. The block 430 represents pixels of the 
display device 254. Each square pixel includes a red 432, green 433 and blue 434 
pixel sub-component. The arrow leading from sample 422 to pixel sub-component 
432 indicates that the sample 422 was used to produce the luminous intensity value 
used to control pixel sub-component 432. The arrow leading from sample 423 to 
pixel sub-component 433 indicates that sample 423 was used to produce the luminous 
intensity value used to control pixel sub-component 433. Similarly, the arrow leading 
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from sample 424 to pixel sub-component 434 indicates that sample 424 was used to 
produce the luminous intensity value used to control pixel sub-component 434. In the 
FIG. 4 example, a single displaced sample is used to generate each pixel sub- 
component luminous intensity value. Such an embodiment, could be implemented 
using a scan conversion filter with a width one sample wide in cases where filtering is 
performed as part of the scan conversion operation. 

In accordance with the present invention, the scan conversion sub-routine 312 
selects, as a function display device and/or user profile information, which one of a 
plurality of possible filters should be used during the scan conversion process. The 
various possible filters are implemented using filter coefficients sometimes referred to 
as tap or filter weights. The filter coefficients which may be used by the scan 
conversion subroutine are obtained, as needed, from the set of scan conversion filter 
coefficients 347. 

The color compensation sub-routine 370 is responsible for processing image 
data, e.g., luminous intensity values, generated by the set of routines 368 to reduce 
and/or eliminate potentially distracting color errors. The processing performed by the 
color compensation sub-routine 370, can have the effect of improving color accuracy 
and reducing color errors, but it normally achieves this result at the expense of some 
degradation in image resolution. In accordance with one exemplary embodiment of 
the present invention, the trade off between resolution and color accuracy is made a 
function of the individual user's preference. This is done, in accordance with the. 
present invention by having the color compensation sub-routine 370 select and use 
one or more filter values, from the set of color compensation filter values 349, as a 
function of user preference information. 

The device driver 371 receives luminous intensity values and other 
information from the graphics display interface 302. It processes the supplied image 
information as a function of display device profile information and user profile 
information which it receives from the stored display device information 345 and the 
stored user profiles 352 to generate luminous intensity values which are output to the 
device driver 371 along with other display information, e.g., character spacing and/or 
positioning information. In addition to outputting the information to the display 
adapter 248, the device driver 371 supplies received display device information, e.g., 
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display device profile information, and user profile information, to the type rasterizer 
306 for use by the routines included therein. 

The content, generation, updating and storage of display device profiles 
(DDPs) included in the set of display information 345 and user profiles 354, 356 
included in the set of user profiles 352 will now be discussed. 

As illustrated in FIG. 3, the set of display device information 345 includes a 
plurality of N DDPs 348, 350, where N represents the number of different supported 
display devices which may be used to display images at any given time by the system 
200. In the set 345 of display device information each DDP corresponds to a different 
one of said N display devices. A user may access a DDP 348 through the operating 
system to verify and/or modify its contents. 

Each DDP 348, 350 includes information identify the display device with 
which it is associated. It also includes the corresponding display device's date of 
manufacture and the type of display. It may also include information on the display 
device's gamut, white point, gamma, pixel pattern, resolution, dot pitch, light 
emitters' element shape and/or method of light modulation. Dot pitch information 
may be included as part of the resolution information. The display device type may 
be CRT, reflective LCD, transmissive LCD, etc. The white point may be expressed in 
tristimulus values or R, G, B luminance values. Pixel pattern may be expressed in 
terms of the order or sequence of color pixel sub-components, e.g., RGB, BGR, 
RGGB, or any other implemented configuration. Display element shape information 
identifies, e.g., the shape of display pixels, e.g., square, rectangular, triangular or 
circular, and/or the shape of pixel sub-components which may also be square, 
rectangular, triangular or circular. The light modulation information indicates, e.g., 
whether color information is spatially or time modulated. In the case of spatial light 
modulation different color light is displayed at different positions on the screen. In 
the case of time modulation, different colors of light are displayed on the same 
portion of the screen at different times. 

The set of user profiles 352 includes a set of Z user profiles 354, 356, where Z 
represents the number of users for which distinct profiles have been created. The user 
profile associated with the user who is logged onto the computer system 200 at any 
particular time is the user profile which is used to control the generation and display 
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of images at said particular time. The user perception information includes 
information on the user's ability to perceive color. This may be expressed as a 
sensitivity to color errors or as a preference for resolution over color accuracy. The 
user profile can. also include user provided information on the user's viewing angle 
and/or position relative to the display screen. The position information may include, 
e.g., viewing angle and/or distance from the screen information. In addition, a user's 
preference for use of a particular gamma value when displaying and/or a user's 
expressed preference for trading off image resolution for color accuracy images may 
be stored in the user profile. Different preferred gamma values may be stored in a 
user profile by a user for use with different display devices. 

In the most common case, a user is a person and therefore a user profile 
normally includes information about a human user's display preferences. However, a 
user profile can be used to store information about preferred display settings for a 
particular application or group of users and not merely for a single individual user. 
Accordingly, for purposes of collecting user preference information, storing user, 
preference information and/or generating user profiles from user preference 
information, a user is to be interpreted broadly to include a group of people or class of 
people or, even a non-human entity such as a video or picture device or application. 
Exemplary devices which may be considered users include video cameras used to 
capture display output. In the case where a user is not an individual, user preferences 
are to be interpreted as information or settings which will produce the best display 
result for the group, device, or application using the display device. 

The user profile generation routine 342 is responsible for generating user 
profiles in response to user input obtained from the input device 340. FIG. 5 
illustrates the steps included in an exemplary user profile generation routine 342. The 
routine starts in step 502, e.g., when the routine is executed in response to a user 
attempting to initially configure the computer system 200, to update an existing user 
profile or to generate a new user profile. Operation proceeds from step 502 to step 
503. 

In step 503, the user is instructed to put the display device 254 in the position 
and location where it will normally be used. After giving the user time to adjust the 
position of the display device operation proceeds to step 504. 
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In step 504 the user is presented with a set of text examples, e.g., examples of 
text generated using different display device gamma values. A pre-selected, e.g., 
default or middle, position of the color accuracy vs. resolution adjustment control is 
used when generating the text examples in step 504. In response to the text examples, 
5 the user can select a desired gamma value by, e.g., clicking on the user preferred text. 

Alternatively, in step 504 the user is presented with a positionable slider 572 
included in a display window 570, as in the FIG. 8 embodiment. The user can select a 
desired gamma value by adjusting the position of slider 572, e.g., by moving the slider 
position control bar 573. 
10 From step 504 operation proceeds to step 506. In step 506 input, e.g., the 

slider setting or selection of preferred text, from the user regarding the user's gamma 
value preference is collected. The effect of any new slider position setting is reflected 
in the exemplary text 574 which is updated to reflect the user's gamma value 
selection. 

15 While the collected gamma preference information may be added to a user 

profile, alternatively, it can be added and thus stored in the display device profile. In 
such a case, the gamma value selected by the user is stored as the display device's 
gamma value in the display device profile associated with the display being used. 
The gamma value stored in the display device profile is then used when displaying 

20 images regardless of the identity of the user. In such an embodiment, the use of the 
gamma slider and user input provides a method of updating gamma value information 
for a particular display device being used. It also provides a method of obtaining a 
gamma value for a display device where one has not been provided by the display 
device manufacturer. 

25 Next, in step 507, the user for whom the profile is being created is presented 

with a screen 550, as illustrated in FIG. 6, of text examples 551, 552, 553, 554, 555, 
556, e.g., with differing degrees of color errors in them. The text examples are 
generated using the gamma setting information obtained in step 506. 

The user may select the preferred text representation by, e.g., double clicking 

30 on the preferred text example. In this manner, a user can indicate his or her ability to 
perceive color. Alternatively the user is presented, as illustrated in FIG. 7, in step 
507, with a screen 560 which includes a user controllable slider 562 and exemplary 
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text 564. The user can indicate the desired trade off between color accuracy and 
resolution by moving the control bar 563 of slider 562 to one of a plurality of settings, 
e.g., indicated by the small vertical lines, e.g., tick marks 565. The effect of any new 
slider position setting is reflected in the exemplary text 564. 
5 In step 508, input from the user is obtained regarding the desired trade off 

regarding color accuracy vs. resolution. This information will normally reflect a 
user's ability to perceive color and/or the user's sensitivity to color errors. The input 
may be in the form of double clicking on displayed text which looks the best to the 
user, as in the FIG. 6 embodiment, or by adjusting the slider position as in the FIG. 7 

10 embodiment. 

Operation proceeds from step 508 to step 510. In step 510 the user is 
presented with a request for information regarding the user's viewing position relative 
to the screen. Viewing information from the user is collected in step 512. Then, in 
step 514, a user profile, e.g., preference information data file, including the particular 

15 viewer's color accuracy vs. resolution preference, gamma value preference and/or 
viewing position information is created. The generated user profile 354 or 356 is 
stored in memory, e.g., in block 352, for future use when the user logs into the 
computer system in which the created user profile is stored. With the storage of the 
generated user profile 354 or 356, operation of the user profile generation routine 342 

20 stops in step 518 pending its re-execution, e.g., to generate a new user profile for a 
different user or take into consideration the use of a new or different display device. 

In accordance with one exemplary embodiment, the slider 562 which allows a 
user to select a desired trade off between resolution and color accuracy controls the 
selection of multiple filter coefficients. The set of filter coefficients is used to control 

25 color correction filters when such filters are employed. Alternatively, e.g., in 
embodiments which use alpha blending, the filter coefficients are used to control 
filters, e.g., red, green and blue filters used during scan conversion, e.g., to perform an 
anti-aliasing filtering operation. In accordance with one particular exemplary 
embodiment, different sets of filter coefficients are stored in memory, e.g., one set of 

30 filter coefficients for each user selectable position of the slider 562. By supporting a 
large number, e.g., more than 20, sets of user selectable positions of the slider 562, the 
user can be presented with what appears to be a contiguous range of settings. While a 
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large number sets of filter coefficients, e.g., m0 re than 20, may be required for such" 
an embochment, given that it takes a relatively small amount of memory to store filter 
coefficient values, such an embodiment is practical given the amount of memory 
commonly available in modern personal computers. 

FIG. 23 illustrates five sets of filter coefficients which may be used as scan 
converse filter coefficients in an embodiment which uses alpha blending. For lower 
filter number settings of the slider 562, sharpness is preferred over color fidelity For 
higher number filter settings of the slider 562, color fidelity is preferred over 
sharpness. Accordingly, use of the filter coefficients in filter set 1 of FIG 23 will 
produce a higher resolution but image than will use of the filter coefficients in filter 
set 5. However, the image resulting from the use of the filter coefficients in filter set 
1 w.11 include more color errors than the image resulting from the use of the filter 
coefficients in filter set 5. 

Each set of filter coefficients included in the table of FIG. 23 includes 
coefficients for a red, a green and a blue anti-aliasing filter having the general 
structure of the red, green and blue filters 1802, 1804, 1806 illustrated in FIG 18 and 
bussed in detail below. 30 filter coefficients are stored in the table illustrated in 
HG. 23 for each of the red, green and blue filters associated with a particular filter 
selects. Thus, while the filters 1802, 1804, 1806 illustrated in FIG. 18 each have 3 
taps implemented using 3 multipliers, the filters used with the coefficients of FIG 23 
would each include 30 taps implemented using 30 multipliers, one for each of the 30 
filter coefficients 30 associated with the red, green and blue filters of FIG 23 The 
input values, e.g., 30 intermediate alpha values, to each of the filters generated using 
the FIG. 23 filter coefficients are presumed to be alpha values which have been 
denved by sampling a source image at a rate of 6 times per pixel segment and then 
summing each pair of samples to produce 3 intermediate alpha values per pixel which 
serve as the input samples to the anti-aliasing filters. The box in each of FIGs 23 A- 
E, identified using numbers 2301, 2302, 2303, 2304, 2305, respectively, indicates the 
filter coefficients and thus filter taps corresponding to the 3 intermediate alpha values 
which correspond to the pixel for which the 3 filtered alpha values are being 
generated. Because separate red, green and blue filters are used, one filtered alpha 
value is produced per color channel resulting in 3 filtered alpha values per pixel The 
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exemplary scan conversion filter coefficients in FIG. 23 are intended for use with a 
white background color and a black foreground color. The sets of coefficients are 
stored in memory 23 and accessed for purposes of scan conversion filtering in 
response to information about the user setting of the resolution vs. color accuracy 
slider 562 maintained in the user profile. Thus, in accordance with the present 
invention, the user's setting of the resolution vs. color accuracy slider 563 determines 
which one of a plurality of stored filter coefficient sets will be used for anti-aliasing 
filtering purposes during scan conversion. For example, setting the control 563 to the 
first, i.e., the left most of tick marks 565 results in the use of the first set of red, green 
and blue filter coefficients, setting the control 563 to the second of the tick marks 
results in the use of the second set of red, green and blue filter coefficients and so on, 
with the setting of the control 563 to the right most tick mark 565 results in the use of 
the fifth set of red, green and blue filter coefficients. 

By storing sets of filter coefficients and selecting the set to be used in response 
to the setting of slider 562, a user is provided with the ability to adjust multiple filter 
coefficients and thus control the shape and response of the anti-aliasing filters 
associated with each of the red, green and blue pixel sub-components. Significantly, 
the slider allows the user to adjust multiple filter coefficients through the use of a 
single somewhat intuitive adjustment which produces predictable results. Such an 
approach to providing a user some control over the selection of filter coefficients is 
more practical than allowing the user direct control over individual filter coefficients 
since separate control over multiple individual coefficients makes it difficult for a user 
to predict the effect on images of various filter coefficient combinations. 

Having discussed the generation and use of user profiles, the creation and use 
of display device profiles will now be described. 

The display device profiles 348, 350, which are included in the set of display 
device information 345, are generated by the display device profile (DDP) generation 
and updating routine 344. The DDP generation and updating routine 344 is illustrated 
in detail in FIG. 9. 

As illustrated, the DDP generation and updating routine 344 begins in start 
step 602, e.g., when the computer system 200 is initially turned on and the routine 344 
is executed by the processor 221. From step 602, operation proceeds to step 604, 
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wherein a determination is made as to whether or not a display device profile already 
exists for the display device to be used, e.g., in display information set 345. If, in step 
604, it is determined that a display profile does not already exist, operation proceeds 
to step 606. In step 606, display device information used in the profile is obtained 
5 from an external source, e.g., from DDP information 246 stored in the display device 
254 or from information provided by the display device manufacturer, e.g., on a 
floppy disk 229. The obtained information may include, e.g., the display device's 
date of manufacture, display type information, the display's gamut, white point and 
gamma value as determined by the device manufacturer, pixel pattern information, 

10 resolution information, information on the physical shape of display elements, and/or 

the display device's method of light modulation. In step 608, a display device profile 
is generated from the received display device information and stored in memory, e.g., 
as one of the DDPs 348 or 350. Arrow 247 of FIG. 3 represents the generation and 
storage of a DDP from display device profile information 246 obtained from display 

15 device 254 under direction of the DDP generation and updating routine 344. 

Referring once again to FIG. 9, it can be seen that operation proceeds from 
step 606 to step 610. In step 604, when it is determined that a display device profile 
already exists for the display device to be used, operation proceeds directly to step 
610. In step 610 display device output characteristics and ambient light conditions are 

20 measured, e.g., using sensor which can be positioned to first measure screen light 
output and then to measure ambient light conditions. From step 610, operation 
precedes to step 612 wherein the existing stored display device profile information is 
updated and/or supplemented using information obtained from the measurements 
made in step 610 and/or one or more estimates of changes in display device 

25 characteristics due to display device age. This may involve, e.g., substituting 
measured or estimated white point, gamma, and/or gamut values for the original 
values supplied, e.g., by the device manufacturer. Information about measured 
ambient light conditions may be added to the device profile or updated as part of the 
device profile updating performed in step 612. In cases where some display device 

30 values which may be affected by age are not measured, in step 612, they are updated 
using estimation techniques. 

Display age information may be obtained by subtracting display device 
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installation information maintained by the operating system from current date 
information also maintained by the operating system. Alternatively, it can be 
obtained using date of manufacture information included in the original display 
device profile. Calculations of changes in gamma and/or gamut values, for example, 
may be made based on the amount of time the display device has been in use when 
actual measurements are not available. 

With the updating of the display profile information in step 612 complete, 
operation proceeds to step 614. Step 614 is a delay (waiting) step. In step 614, the 
DDP generation and updating routine waits until a preselected period of time has 
passed since the last DDP update which occurred in step 612 has passed. Operation 
then proceeds from step 614 to step 610. Thus, step 614 provides a mechanism for 
controlling the periodic updating of the DDP information as a function of a 
preselected,' e.g., user or operating system manufacturer, specified period of time 
between DDP information updates. 

Having described the generation, content, and updating of the DDPs 348, 350 
and user profiles 354, 356, the use of the display and user profiles to generate display 
images will now be described with reference to FIG. 10. 

FIG. 10 illustrates a routine 700 for displaying images such as text, in accordance 
with the present invention. The routine 700 starts in step 702, wherein the scaling, 
hinting, scan conversion and color compensation sub-routines 308, 310, 312, 370 are 
loaded into memory. 

Then, in step 704, input utilized in generating the images to be displayed is 
obtained. The input includes text information 337 output by application 236. The 
text information includes information identifying the text characters to be displayed, 
the font to be used, the text point size to be used and background/foreground color 
information. The input also includes display device information 715 which includes 
the display device profile 348, 350, discussed in detail above, for the display device 
which will be used to display the generated images. A high resolution representation 
of text characters, e.g., an outline font file stored as part of the operating system 235 
also serves as input to step 704. The outline font file 305 may include scalable 
character outlines represented using lines, points and curves as well as character 
spacing information. The operating system identifies to the routine 700 the user who 
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is logged into the computer system 200 at any given time. Additional input obtained 
in step 704 includes user profile information 352 which includes the user profile 354 
or 356 of the user who is logged into the computer system 200 at the time the images 
are being processed for display. The contents of the user profile 354 or 356, 
5 associated with the user who is logged into the computer system 200, are used, e.g., 
by the color compensation sub-routine 370, when processing images for display. The 
input obtained in step 704 is available for use by any one of the sub-routines 308, 310, 
312,370. 

For purposes of explanation, it will be assumed that the information in DDP 
10 348 and user profile 354 are used by the routine 700 to generate the images to be 
displayed. 

Once the input is obtained in step 704, operation proceeds to step 710 where a 
scaling operation is performed on the text to be rendered as a function of the DDP 
information obtained in step 704. Display type information, e.g., LCD or CRT, pixel 

15 pattern, e.g., vertical or horizontal striping information, element shape information, 
e.g., rectangular or square, and/or resolution, e.g., dot pitch, information are used to 
determine the appropriate type of scaling to be performed. In accordance with one 
embodiment of the present invention, scaling is performed for CRT displays at equal 
rates in the horizontal and vertical dimensions. However, for LCD displays, scaling 

20 in the horizontal and vertical directions depends on pixel sub-component shape and, 
in the case of striped displays, on the direction of striping. Super-sampling may be 
performed as an alternative to the described scaling followed by sampling. 

In accordance with the present invention, scaling of text to be displayed on 
striped LCD displays is performed as a function of the point size and resolution 

25 information in a direction perpendicular to the direction to striping, e.g., at a rate 
greater than the rate of scaling performed in the direction of striping. The difference 
in amount of scaling between the direction perpendicular to the direction of striping 
and parallel to the direction of striping is normally equal to or greater than the number 
of pixel sub-components per pixel. 

30 FIG. 1 1 illustrates an exemplary scaling of a character outline 1102 performed 

when the display device profile information indicates that the display device being 
used is an LCD display with pixels comprised of rectangular RGB pixel sub- 
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components, which are 1/3 as tall as they are long, arranged to form RGB stripes 
extending in the horizontal direction. Note that scaling in the vertical direction is 
performed at a rate 3 times the scaling performed in the horizontal direction to 
produce the scaled character outline 1 104. 
5 FIG. 12 illustrates exemplary scaling of the character outline 1102 performed 

when the display device profile information indicates that the display device being 
used is an LCD display with pixels comprised of rectangular RGB pixel sub- 
components, which are 1/3 as long as they are tall, arranged to form RGB stripes 
extending in the vertical direction. Note that scaling in the horizontal direction is 

10 performed at a rate 3 times the scaling performed in the vertical direction to produce 
the scaled character outline 1 108. 

Scaling performed for CRT displays, in accordance with one embodiment of 
the present invention, unlike the scaling performed for striped LCD displays, is 
performed at a uniform rate in both the horizontal and vertical dimensions. 

15 After scaling in step 710, the data representing the scaled image is processed, 

in step 712 to perform a hinting operation as a function of display device profile 
information. Utilized device profile information includes display type, pixel pattern 
information and/or display resolution information. In the case of LCD displays, 
hinting is also performed as a function of pixel sub-component boundaries and/or a 

20 user's indicated preference for resolution vs. color accuracy. Hinting of images for 
display on CRT display, in one embodiment, is not performed as a function of pixel 
sub-component boundaries but rather pixel boundaries. The term grid-fitting is 
sometimes used to describe the hinting process. 

Hinting operations performed for characters intended to be displayed on LCD 

25 displays are illustrated in FIGs. 13, 14, 15 and 16. Solid lines in the grids 1302, 
1404, 1502, 1604 used in FIGs. 13, 14, 15 and 16, respectively, are used to illustrate 
pixel boundaries while dotted lines are used to illustrate pixel sub-component 
boundaries. The letters R, G, B are used to indicate portions of the grid which 
correspond to red, green and blue pixel sub-components of a display device, 

30 respectively. CI, C2, C3, C4 are used to indicate pixel columns 1 through 4. 

FIG. 13 illustrates the hinting of the scaled character outline 1104 which is 
intended to be displayed on an LCD display with horizontal striping in the case where 
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a user has indicated that color accuracy is preferred over image resolution FIG. 14 
illustrates the hinting of the scaled character outline 1108 which is intended to be 
displayed on an LCD monitor with vertical striping in the case where a user has 
indicated that color accuracy is preferred over image resolution. The user's 
preference for color accuracy vs. image resolution is determined from the user profile 
information 354. 

FIG. 15 illustrates the hinting of the scaled character outline 1104 which is 
intended to be displayed on an LCD display with horizontal striping in the case where 
a user has indicated that image resolution is preferred over color accuracy. FIG. 16 
illustrates the hinting of the scaled character outline 1108 which is intended to be 
displayed on a LCD monitor with vertical striping in the case where a user has 
indicated that image resolution is preferred over color accuracy. The user's 
preference for color accuracy vs. image resolution is determined from the user profile 
information 354. 

Hinting involves the alignment of a scaled character including, e.g., the 
character outline 1004, 1008, within a grid 1302, 1404, 1502, or 1604 that is used as 
part of a subsequent scan conversion operation. It also involves the distorting of 
character outlines so that the image better conforms to the shape of the grid. The grid 
is determined as a function of the physical shape, size and arrangement of a display 
device's pixel elements as indicated in accordance with the present invention by the 
DDP information. 

When hinting for LCD displays, the present invention treats pixel sub- 
component boundaries as boundaries along which characters can and should be 
aligned or boundaries to which the outline of a character should be adjusted. 

Hinting, implemented in accordance with the present invention as a function 
of pixel sub-component boundaries, can be used to reduce color distortions, e.g., color 
artifacts, that may be introduced as the result of treating each of the different color 
pixel sub-components as an independent luminous intensity source. 

Adjusting the placement of an edge, e.g., as part of the hinting process, can 
have a significant effect in terms of reducing or eliminating color artifacts. For 
frequently used individual images, e.g., characters, edge placement information can 
be determined by a skilled typographer and stored in memory as part of the font 
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information used for character generation. 

Hinting to reduce color errors in the case of LCD displays can reduce the 
display resolution since the position of the outline is adjusted to reduce color errors as 
opposed to optimizing character spacing and resolution. Thus, in accordance with one 
5 embodiment of the present invention hinting to reduce color errors is avoided or 
performed to reduce large color errors when the user profile 354 indicates a 
preference for resolution over color accuracy. 

During the hinting operation, character outlines are aligned with various pixel 
and pixel sub-component boundaries according to stored, generally applicable hinting 

10 rules which, in accordance with the present invention are applied a function of 
information included in the DDP 348 and/or the user profile 354. 

The hinting process of the present invention applied in the case of striped LCD 
displays involves aligning the scaled representation of a character within the grid, e.g., 
along or within pixel and pixel sub-component boundaries in a manner intended to 

15 optimize the accurate display of the character using the available pixel sub- 
components. In many cases, this involves aligning the left edge of a character stem 
with a left pixel or sub-pixel component boundary and aligning the bottom of the 
character's base along a pixel component or sub-component boundary. 

Experimental results have shown that in the case of vertical striping, 

20 characters with stems aligned so that the character stem has a blue or green left edge 
generally tend to be more legible, to people able to detect colors, than characters with 
stems aligned to have a red left edge. Accordingly, in embodiments where hinting is 
performed to reduce color errors, e.g., because a user has expressed a preference for 
color accuracy over resolution, during hinting of characters to be displayed on a 

25 screen with vertical striping, blue or green left edges for stems are favored over red 
left edges as part of the hinting process. 

In the case of horizontal striping, characters aligned so that the bottom of the 
character base has a red or blue bottom edge generally tend to be more legible, to 
people able to detect colors, than characters with bases aligned to have a green bottom 

30 edge. Accordingly, in embodiments where hinting is performed to reduce color 
errors, e.g., because a user has expressed a preference for color accuracy over 
resolution, during hinting of characters to be displayed on a screen with horizontal 
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striping, red or blue bottom edges are favored over green bottom edges as part of the 
hinting process. 

In cases where a user has indicated a preference for image resolution over 
color accuracy, the color of edges of charter outlines is ignored and hinting is 
5 performed to optimize character spacing and shape. 

FIG. 13 illustrates the application of a hinting operation to the scaled image 
corresponding to outline 1104 is to be displayed on an LCD display with horizontal 
striping and where the user has indicated a preference for color accuracy over 
resolution. As part of the hinting process, the scaled image 1104 is placed on a grid 
10 1302 and its position and outline are adjusted to better conform to the grid shape and 

to achieve a desired degree of character spacing. The letters "G.P." in FIGs. 13-16 
indicate the grid placement step while the term hinting is used to indicate the outline 
adjustment and character spacing portions of the hinting process. 

Note that in FIG. 13 where the image 1104 is hinted for display on a screen 
15 having horizontal striping taking into consideration color errors, the scaled image 

1104 is positioned along the R/G pixel sub-component boundary so that the base of 
the character represented by character outline 1302 will have a red bottom edge. The 
shifting of the image outline so that the displayed character will have a red bottom 
edge represents a color correction operation. In addition to character outline 
20 positioning, the image's outline is adjusted so that rectangular portions of the image 
adjoin pixel sub-component boundaries. This results in the hinted character outline 
1314. The distance between the character outline 1314 and left and right side bearing 
points (not shown) used for determining character position and spacing on the screen 
are also adjusted as a function of pixel sub-component boundaries. Thus, in various 
25 LCD embodiments of the present invention, character spacing is controlled to a 
distance corresponding to the width of a pixel sub-component, e.g., 1/3 of a pixel 
width. 

FIG. 14 illustrates hinting of the image outline 1108 for display on a LCD 
display having vertical striping for a user who has indicated a preference for color 
30 accuracy over image resolution. In FIG. 14, the scaled character outline 1108 is 
positioned along the R/G pixel sub-component boundary so that the left edge of the 
stem of the hinted character 1118 has a green left edge.. The shifting of the character 
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outline 1108 to provide the stem with a green left edge represents a color correction 
operation. In addition to character outline positioning, the shape of the character 
outline 1 108 is also adjusted. 

FIG. 15 illustrates the hinting of the character outline 1104 for display on an 
5 LCD display with horizontal striping in the case where the user has indicated a 
preference for resolution over color accuracy. In the FIG. 15 example color 
correction steps are not performed as part of the hinting processes. Note that in the 
FIG. 15 example, the color of the bottom character edge is not used in determining 
character outline position during the hinging process. Thus, the character image will 

10 have a blue bottom edge due to the positioning of the hinted character outline 1514 as 
opposed to a red bottom edge as in the case of the FIG. 13 example. 

FIG. 16 illustrates the hinting of the character outline 1108 for display on an 
LCD display with vertical striping in the case where the user has indicated a 
preference for resolution over color accuracy. In the FIG. 16 example color 

1 5 correction steps are not performed as part of the hinting processes. Note that in the 

FIG. 16 example, the color of the character stem left edge is not used in determining 
character outline position during the hinting process. Thus, the character image will 
have a blue stem left edge due to the positioning of the hinted character outline 1618 
as opposed to a green stem left edge as in the case of the FIG. 14 example. 

20 Referring once again to FIG. 10, after hinting is performed in step 712, a scan 

conversion operation is performed on the scaled hinted image which includes a 
character outline. In accordance with the present invention, scaling is performed as a 
function of information included in the display device profile 348 and/or user profile 
354. 

25 Scan conversion step 714 is performed, in an exemplary embodiment, through 

a call to scan conversion sub-routine 1700 illustrated in FIG. 17. Sub-routine 1700 
will be discussed in detail below. Scan conversion step 714 generates a bitmap 
. representation of the image to be rendered. That is, the output of scan conversion step 
714 includes separate scan conversion output values corresponding to each pixel or 
30 pixel sub-component used to represent an image. 

In accordance with the present invention, in the case of RGB striped LCD 
displays, a scan conversion output value is generated per pixel sub-component, e.g., 3 
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scan conversion output values are generated per pixel. The scan conversion output 
values may be used as blend coefficients. Alternatively, the scan conversion output 
values can, in LCD embodiments, be treated as pixel sub-component luminous 
intensity level values that can fall within a range extending from a luminous intensity 
value used to specify the minimum light output of a pixel sub-component and the 
maximum light output of a pixel sub-component. Assuming a black foreground, the 
minimum luminous intensity value, e.g., 0, would correspond to an "on" pixel sub- 
component. Assuming a maximum luminous intensity value of 255, and a white 
background, an "off' scan conversion output value would correspond to the value 
255. Values in between 0 and 255 indicate pixel sub-components which correspond 
to part foreground and part background. 

In the case where the scan conversion output values are treated as blend 
coefficients, user foreground and background color selections are applied by the 
device driver 371 using alpha blending techniques and operation proceeds directly 
from step 714 to step 718. 

In the case where the scan conversion output values are treated as pixel sub- 
component luminous intensity levels, the scan conversion output values are processed 
in step 715 to apply foreground and background color selections and then a color 
compensation operation is performed, in step 716 as a function of the user's expressed 
preference regarding resolution vs. color accuracy. A user's preference may, at least 
in part, be driven by categories of color vision deficiency such as varying degrees of 
difficulty distinguishing between red and green shared by a considerable percentage 
of the adult male population. Steps 715 and 716 are illustrated using dashed lines 
since they are skipped in embodiments where the scan conversion output values are 
treated as blend coefficients. 

In step 715, the foreground and background color information 351 is used to 
apply foreground and background color selections to scan conversion output values, 
each of which corresponds to a R, G, or B pixel sub-component in the case of an RGB 
striped display. The foreground color is specified in the set of color information 351 
as red, green, and blue pixel sub-component luminous intensity values Rf, Gf, and Bp 
which, when used to control the red, green and blue foreground pixel sub-components 
of a pixel, respectively, produce a foreground colored pixel. Similarly, the 
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background color is specified in the set of color information 351 as red, green, and 
blue background pixel sub-component luminous intensity values Rf, Gf, and Bf 
which, when used to control the red, green and blue pixel sub-components of a pixel, 
respectively, produce a background colored pixel. 
5 In step 715, pixel sub-component scan conversion output values corresponding 

to either a foreground or a background color are replaced with the corresponding 
foreground or background pixel sub-component luminous intensity value. For 
example Rb would be substituted for a red pixel sub-component scan conversion 
output value of 0, Gb would be substituted for a green pixel sub-component scan 

10 conversion output value of 0, and Bb would be substituted for a blue pixel sub- 
component scan conversion output value of 0. Assuming the maximum scan 
conversion output value is 255 and that this value indicates a foreground colored pixel 
sub-component, Rf would be substituted for a red pixel sub-component scan 
conversion output value of 255, Gf would be substituted for a green pixel sub- 

15 component scan conversion output value of 255, and Bf would be substituted for a 
blue pixel sub-component scan conversion output value of 255. For purposes of 
simplicity of implementation, scan conversion output values falling between 0 and 
255 may be clamped to the corresponding closer one of the foreground or background 
pixel sub-component luminous intensity level values. For example, R, G, and B pixel 

20 sub-component scan conversion output values of 85 may be set to pixel sub- 
component luminous intensity level R B , G B > B B , respectively. In addition, R, G, and 
B pixel sub-component scan conversion output values of 170 may be set to pixel sub- 
component luminous intensity level Rf, Gf, Bf, respectively. 

As opposed to clamping pixel sub-component luminous intensity values to a 

25 foreground or background pixel sub-component luminous intensity value, it is 

possible to set them to a value in between the foreground and background luminous 
intensity values as a function of the scan conversion output value. 

However, by limiting pixel sub-component luminous intensity values to 
foreground or background pixel sub-component luminous intensity values, the 

30 number of potentially distracting color errors can be significantly reduced at some 
expense in terms of resolution. 

Regardless of how the foreground and background colors are applied to 
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produce pixel sub-component luminous intensity values, distracting color errors may 
occur as the result of the use of displaced samples during scan conversion. Whether a 
color error is distracting or not is a function of the user's sensitivity to color. Since 
color error reduction is usually at the expense of image resolution, color 
5 compensation may be skipped or minimized for users who are not sensitive to color 
errors or who have indicated a preference for resolution vs. color accuracy. 

Color compensation step 716 is performed on the data, representing a 
bitmapped image, output by step 715. Color compensation filter values are selected 
from the set of values 349 as part of step 716. The selection of filter values is made 

10 based on a user's preference for resolution vs. color accuracy as indicated by 
information in the user profile 354. A color compensation sub-routine 2150, 
illustrated in FIG. 21, is suitable for performing color compensation step 716. Color 
compensation sub-routine 21 50 will be discussed in detail below. 

In both the case where scan conversion output values are treated as blend 

15 coefficients and the case where scan conversion output values are treated as pixel sub- 
component luminous intensity levels, the scan conversion filter may be selected so 
that it performs both anti-aliasing and color compensation filtering functions. In such 
embodiments, the scan conversion filter coefficients, which include multiple 
coefficients, are selected both as a function of the device profile information and the 

20 user preference information. Accordingly, in such embodiments, multiple scan 
conversion filter coefficients are selected from a single value, e.g., slider position 
setting, indicating a user's preference for resolution vs. color accuracy. After the 
color compensation operation is performed in step 716 operation proceeds to step 718. 
In step 718, the generated data representing the bitmap representation of the 

25 image to be displayed, produced by step 716 or, alternatively, step 714 when steps 
715 and 716 are omitted, is output to the device driver for further processing. 
Operation of the routine 700 then stops in step 720 pending a new call to the routine 
700, e.g., by the operating system. 

Exemplary scan conversion and color compensation operations will now be 

30 discussed in detail. 

FIG. 17 illustrates an exemplary scan conversion sub-routine 1700 suitable for 
implementing scan conversion step 714 of routine 700. Scan conversion sub-routine 
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1700 begins in step 1702 wherein it starts executing. Then in step 1704, a 
determination is made, using information in the display device profile 348, as to the 
image sampling method to be used. Determining the image sampling method 
involves, e.g., selecting the sampling rate in the horizontal and/or vertical directions to 
be used when sampling the image represented by the hinted image outline. 

For example, in one embodiment, when the DDP 348 indicates that a CRT 
display is being used, a sampling method which involves sampling the image in the 
horizontal and vertical dimensions at the same rate is used. In one such embodiment, 
R, G, B pixel sub-component luminous intensity values for a pixel of a CRT display 
are generated from samples, e.g., samples obtained by sampling the scaled hinted 
image at a rate of four samples per pixel in both the horizontal and vertical 
dimensions. 

When the DDP 348 indicates that an LCD display with RGB horizontal 
striping is being used, the image is sampled at a rate in the vertical dimension which 
is three times greater than the rate in the horizontal dimension. In the same exemplary 
embodiment, when the DDP 348 indicates that an LCD display with RGB vertical 
striping is being used, the image including the hinted image outline is sampled at a 
rate in the horizontal dimension which is three times greater than the rate in the 
vertical dimension. Other sampling rates are also possible. 

When the DDP 348 indicates that a striped LCD display is being used, 
different sets of character image samples are used to generate each scan conversion 
output value used to control the R, G, and B pixel sub-components of a pixel. 
Normally, in accordance with the present invention, different displaced image 
portions are used to generate the samples from which the scan conversion output 
values, corresponding to each LCD pixel sub-component of a pixel, are generated. 
The different image portions may, but need not be, over lapping image portions. 

After the sampling method has been selected in step 1704, operation proceeds 
to step 1705 wherein a set of scan conversion filter coefficients, e.g., filter weights, 
are selected to implement filters used during a scan conversion filtering operation. 

Different anti-aliasing filters may be implemented by selecting different sets 
of filter weights, sometimes referred to as filter coefficients. Exemplary anti-aliasing 
filters will be discussed below with regard to FIG. 19. 
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After selection of the filter coefficients, in step 1706, the image including the 
character outline representing foreground/background information, is sampled. 

One or more known techniques may be used for sampling the image. In one 
embodiment, if the center of the grid segment being sampled is within the character 
outline, the sample is determined to be "on" and is set to a value of one. If the center 
of the grid segment being sampled is outside the character outline, the sample is 
determined to be "off' and set to a value of zero. An "on" sample indicates that the 
sample corresponds to the image foreground color while vYOfFIY indicates that the 
sample corresponds to the image background color. 

The sample values generated in step 1706 are filtered in step 1708. In step 
1708, an anti-aliasing filtering operation is performed on the image samples to 
produce one or more values indicative of the portion of each image region to which 
the scaled value corresponds that is due to the foreground color and the portion of the 
image region which is due to the background color. Accordingly, the output of the 
filtering operation may be 

used as a foregroundtoackground blend coefficient sometimes referred to as an alpha 
value. Alternatively, as discussed above, it can be used as a luminous intensity level 
indicative of a luminous intensity value in the range extending from full "on" to full 
"off". 

The scan conversion output values produced by filtering step 1708 are 
returned to the routine which initiated the call to the scan conversion sub-routine 
1700. Operation of the routine 1700 is then stopped in step 1712 pending the 
processing of addition image data. 

The scan conversion output values may be expressed as a value in a range, 
e.g., 0-3, having a fixed number of possible values. In such an embodiment each 
value in the range 0-3 represents one of four distinct blend coefficients (alpha values) 
or luminous intensity levels. For purposes of subsequent image processing 
operations, it is frequently convenient to process the scan conversion output values, 
corresponding to separate R, G, B pixel sub-components, as 8 bit values falling in the 
range of 0-255. Accordingly, in the exemplary embodiment the scan conversion 
output values produced by the scan conversion filtering step 1708 are, converted to 
the range of 0-255 prior to being returned in step 1710. The conversion operation 
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may be included in routine 1700 as part of return step 1710 or as an additional step 
prior to step 1710. In such an embodiment, 0 would correspond to the minimum 
possible scan conversion output value, 255 to the maximum scan conversion output 
value, and values between 0 and 255 would correspond directly and proportionately to 
values between the minimum and maximum scan conversion output values. 

While in the exemplary embodiment, the scan conversion output values for 
each pixel sub-component of an LOD display are set to a value between 0 and 255, it 
is contemplated that, in some embodiments, the scan conversion output values would 
not be immediately converted into 8 bit values but would be stored and/or processed 
in a compressed format. The use of a compressed format allows savings in both the 
amount of memory used to store the scan conversion output values and the bus 
bandwidth required to communicate the values. However, for purposes of 
explanation e.g., of the color compensation sub-routine 2150, it will be assumed that 
scan conversion output values are converted to values ranging from 0 to 255. 

Having generally described the scan conversion sub-routine 1700, anti- 
aliasing filters suitable for use as scan conversion filters will now be described with 
regard to FIG. 18. 

FIG. 18 illustrates exemplary anti-aliasing filters which are used to implement 
an exemplary anti-aliasing filtering operation as part of a scan conversion operation 
when the DDP information indicates that the display device is an RGB striped LCD 
display. Use of other filters as scan conversion filters is also possible, e.g., filters with 
more or less than three filter taps may be used. 

In the FIG. 18 example, separate red, green and blue filters 1802, 1804, 1806 
are used to generate the scan conversion output values used to control each of the red, 
green and blue pixel sub-components of a pixel. The filter input samples, in the FIG. 
18 embodiment, are obtained from sampling the scaled, hinted character image 
including the character outline being processed, at a rate of three samples per pixel in 
the direction perpendicular to the direction of striping. At least some of the input 
samples supplied to each of the filters 1802, 1804 and 1806 will come from different 
image portions. Accordingly, the scan conversion output values generated by filters 
1802, 1804 and 1806 correspond to different image portions. 

Each filter 1802, 1804, 1806 comprises first, second and third multipliers 
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1803, 1805, 1807 and a summer 1809. Operation of the red scan conversion filter 
1802 will be explained with the understanding that the green and blue scan conversion 
filters operate in a similar manner using different sets of input samples and possibly 
different filter coefficients. 
5 First, second, and third input samples RSI, RS2, RS3 are supplied to the first 

second and third multipliers 1803, 1805 and 1807, respectively, and are multiplied by 
the first, second, and third red scan conversion filter coefficients RW1, RW2, RW3, 
respectively. In step 1805 of the exemplary scan conversion routine discussed above, 
the filter coefficients RW1, RW2, RW3 were selected from the stored scan conversion 

10 filter coefficients 347 as a function of the information included in the DDP 348. 

The output of the first, second, and third multipliers 1803, 1805, 1807 is 
summed by the summer 1809 to produce a red pixel sub-component luminous 
intensity value. By selecting the filter coefficients RW1, RW2, RW3, to all be the 
same value, a square box filter is implemented. 

15 • Assuming the use of the value one for each of the filter coefficients and input 

sample values of 0 or 1, the outputs of the scan conversion filters 1802, 1804, 1806 
may assume the values 0 through 3. 0 indicating a background colored pixel sub- 
component, three indicating a foreground color pixel sub-component and a value of 1 
or 2 indicating a pixel sub-component corresponding to a mix between the foreground 

20 and background colors. 

The green and blue scan conversion filters 1804, 1806 operate in the same 
manner as the red scan conversion filter 1802 to produce scan conversion output 
values used to control the luminous intensity level of green and blue pixel sub- 
components, respectively. 

25 As discussed above, for purposes of subsequent image processing, the scan 

conversion output values 0-3 may be, and in this exemplary embodiment are, 
converted to the range of 0-255, e.g., as part of return step 1710 of routine 1700. In 
such an embodiment, output filter value 0 results in a 0 being returned as the scan 
conversion pixel sub-component output value, an output filter value of 1 results in the 

30 value 85 being returned as the scan conversion pixel sub-component output value, an 
output filter value of 2 results in the value 171 being returned as the scan conversion 
pixel sub-component output value, and the output filter value of 3 results in the value 
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255 being returned as the scan conversion pixel sub-component output value. 

FIGs. 19 and 20 are pictorial representations of scan conversion operations 
performed on scaled hinted images intended to be displayed on LCD displays having 
horizontal RGB striping and vertical RGB striping, respectively. Note that FIG. 19 
illustrates performing a scan conversion operation on the image which includes 
character outline 1014. FIG 20 illustrates performing a scan conversion operation on 
the image which includes character outline 1018. In FIGs. 19 and 20, solid dots in 
grids 1102 and 1104 are used to indicate image samples while brackets are used to 
indicate the sets of samples which are supplied to each of the R, G, and B scan 
conversion filters illustrated in FIG 18. 

Note in the FIG. 19 and 20 examples three samples are used to generate the 
scan conversion value corresponding to each pixel sub-component luminous intensity 
value, "on" samples corresponding to image foreground are illustrated in grids 1202 
and 1203 as solid dots. Note that each grid segment of the grid 1202, 1203 includes 
between zero and three dots. Grid segments which include no "on" samples are 
shown in grids 1202, 1203 using specking to illustrate the different rows of red, green 
and blue pixel sub-components to which each grid segment corresponds. Light 
speckling is used to indicate correspondence to a blue pixel sub-component, medium 
specking is used to indicate correspondence to a red pixel sub-component and dark 
speckling is used to indicate correspondence to a green pixel sub-component. 

Grids 1212 and 1214 are pictorial representations of the scan conversion 
output values generated by supplying the filter sample values illustrated in grids 1202, 
1204 to the scan conversion filters illustrated in FIG. 18, assuming the use of filter 
coefficients of the value 1. In grids 1212, 1214, 15 white indicates a scan conversion 
output value of 0, light speckling indicates a scan conversion filter output value of 1, 
medium speckling indicates a scan conversion output value of 2, and dark speckling 
indicates a scan conversion output value of 3. In FIGs. 18 and 19, a scan conversion 
filter output value of 0 indicates a background image area, a scan conversion filter 
output value of 3 indicates a foreground image area, a scan conversion filter output 
value of 1 indicates an image area which corresponds more to the background than the 
foreground, and a scan conversion filter output value of 2 indicates a scan conversion 
filter output value which corresponds more to the foreground than the background. 
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Having described the scan conversion process of the present invention in 
detail, a pixel color processing sub-routine 2150 suitable for implementing color 
compensation step 716 will now be described with reference to FIG. 21. Sub-routine 
2150 is used to process the pixel sub-component luminous intensity values of each 
5 pixel of an image. 

The sub-routine 2150 begins in step 2152 and proceeds to step 2153 wherein 
filter parameters are selected and loaded into memory. The filter parameters selected 
from the set of color compensation filter values 349 as a function of user profile 
information 354 which indicates a user's preference for resolution vs. color accuracy. 

10 The user profile 348 of a user who is logged into the computer system executing the 
color compensation routine 2150 is used to provide the user preference information. 
In this exemplary embodiment, the filter parameters include thresholds which 
determine when a color correction operation is performed. The stronger the user 
preference for resolution over color accuracy the higher the threshold values which 

15 are selected for determining when to perform a color correction operation. Other 
parameters, e.g., filter coefficients, used to control the amount of change in pixel sub- 
component luminous intensity values when a color correction operation is to be 
performed are also selected as a function of the user preference information. Filter 
coefficients which will produce a relatively small correction in detected color errors 

20 are selected when a user indicates a strong preference for resolution over color 
accuracy. However, when a user indicates a preference for color accuracy over 
resolution, filter coefficients which result in larger corrections in pixel sub-component 
luminous intensity values are selected. 

Once the filter parameters are selected and loaded into memory, step 2153 

25 may be skipped in future iterations of the sub-routine 2150 until such time as the user 
who is logged into the machine changes the user preference information or a new user 
logs into the computer system in place of the original user. 

In sub-routine 2150, two (2) filters namely a red filter and a blue filter are 
provided. In the exemplary embodiment, the red filter uses a red threshold, a red 

30 factor, and a green factor. The blue filter uses a blue threshold, a green factor, a blue 
factor, and a red factor. The red and blue filters may be implemented in stages. In the 
sub-routine 2150 the initials CP are used to indicate values associated with the current 



WO 00/45365 



PCT/US00/0216? 



38 

pixel being processed. For example Rcp is used to indicate the pixel sub-component 
luminous intensity value of the red pixel sub-component of the current pixel being 
processed. 

In decision step 2156, if it is determined that the difference between the red 
5 and green pixel sub-component luminous intensity values (Rcp-Gcp) of a pixel is 
greater than the red filter threshold value, operation proceeds to step 2158. In step 
2158, the red pixel sub-component luminous intensity value (Rcp) is decreased and/or 
the green pixel sub-component luminous intensity value is increased. This step may 
be carried out in accordance with the following expressions: 
10 if (Rcp - G C p) > Red Filter Threshold, then 

Rcp' = Rcp -((Rcp - G C p) * Red Filter Red Factor)/ 10 

Gcp = G C p + ((Rcp - G C p) * Red Filter Green Factor)/10 

Set Rcp ~ Rcp' 

Set Gcp — Gcp 1 

15 where Rcp' is the updated red pixel sub-component luminous intensity value, 

and G C p is the updated green pixel sub-component luminous intensity value. 

Processing proceeds from step 2158 to decision step 2157. Operation 
proceeds directly from step 2156 to step 2157 if it is determined in step 2156 that the 
difference, between the red and green pixel sub-component luminous intensity values 
20 (Rcp-Gcp) of a pixel, is less than or equal to the red filter threshold value. 

In decision step 2157, if it is determined that the difference between the green 
and red pixel sub-component luminous intensity values (Gcp - Rcp) is greater than the 
red filter threshold value operation proceeds to step 2159. In step 2159 the red pixel 
sub-component luminous intensity value (Rcp) is increased and/or the green pixel sub- 
25 component luminous intensity value is decreased. 

Steps 2156, 2158, 2157 and 2159 in combination comprise a red filter which 
reduces the difference between the red and green pixel sub-component values when 
the magnitude of the difference between these values exceeds the red threshold. 

Processing proceeds from step 2159 to decision step 2160. Operation 
30 proceeds directly from step 2157 to step 2160 if it is determined in step 2157 that the 
difference between the green and red pixel sub-component luminous intensity values 
(Gcp-Rcp) is less than or equal to the red filter threshold value. 
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In decision step 2160, if it is determined that the difference between the green 
and blue pixel sub-component luminous intensity values (Gcp - Bcp) is greater than 
the blue filter threshold value, operation proceeds to step 2162. In step 2162 the 
green pixel sub-component luminous intensity value (Gcp) is decreased, and/or the 
5 blue pixel sub-component luminous intensity value (Bcp) is increased, and/or the red 

pixel sub-component luminous intensity value (Rep) is decreased. This step may be 
carried out in accordance with the following expressions: 

if (G C p - B C p) > Blue Filter Threshold, then 

Gcp = Gcp-((Gcp - B C p) * Blue Filter Green Factor) /10 
10 B cp = B cp + ((Gcp - B C p) * Blue Filter Blue Factor)/10 

Rcp = Rcp - ((Gcp - B C p) * Blue Filter Red Factor)/10 

SETR C p = Rcp 

SET Gcp = Gcp 

SET B cp = B cp 1 

1 5 Where Rcp* is the modified red pixel sub-component luminous intensity value, 

Bcp* is the modified blue pixel sub-component luminous intensity value and Rcp 1 is 

the modified red pixel sub-component luminous intensity value. 

Processing proceeds from step 2162 to decision step 2161. Operation 

proceeds directly from step 2160 to step 2161 if it is determined in step 2160 that the 
20 difference between the blue and green pixel sub-component luminous intensity values 

(G cp - B cp) is less than or equal to the blue filter threshold value. 

In decision step 2161, if it is determined that the difference between the blue 

and green pixel sub-component luminous intensity values (B cp - G cp) is greater than 

the blue filter threshold value, operation proceeds to step 2163. In step 2163 the 
25 green pixel sub-component luminous intensity value (Gcp) is increased, and/or the red 

pixel sub-component luminous intensity value (Rcp) is decreased and/or the blue 

pixel sub-component luminous intensity value (Bcp) is decreased. 

Steps 2160, 2162, 2161 and 2163 in combination comprise a blue filter which, 

in most embodiments, reduces the difference between the blue and green pixel sub- 
30 component values when the magnitude of the difference between these values exceeds 

the blue threshold. 

Processing proceeds from step 2163 to return step 2164. Operation proceeds 
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directly from step 2161 to step 2164 if it is determined in step 2161 that the difference 
between the blue and green pixel sub-component luminous intensity values (BCP- 
GCF) is less than or equal to the blue filter threshold value. 

In return step 2164, the values Rep, Gcp and B C p are output or returned to the 
routine which called the pixel color processing sub-routine 2152. In this manner, 
filtered pixel sub-component luminous intensity values are returned. 

Some exemplary values for FIG. parameters or variables are: 

Red Filter Threshold = 100; 

Red Filter Red Factor = 3; 

Red Filter Green Factor = 2; 

Blue Filter Threshold = 128; 

Blue Filter Red Factor = 2; 

Blue Filter Green Factor = 1 ; and 

Blue Filter Blue Factor = 3 

In cases where a user indicates a strong preference for resolution over color 
accuracyl the filter thresholds would be higher. For example, the following filter 
threshold values might be used; 

Red Filter Threshold = 185; 

Blue Filter Threshold = 200. 

By processing pixel sub-component luminous intensity values using the above 
described pixel color processing sub-routine, color errors can be reduced or 
eliminated. 

The various routines which comprise the graphics display interface 302, e.g., 
rendering and rasterization routines 307, have been described in detail. The output of 
the graphics display interface 302 are bitmapped images represented, in the case of an 
LCD display embodiment, using either alpha values, e.g., one per pixel sub- 
component, or as pixel sub-component luminous intensity values. 

The bitmapped images output by the graphics display interface 302 are 
supplied to the device driver 371 for further processing. Operation of the device 
driver 371 will now be discussed in detail with reference to FIG. 22. 

As illustrated in FIG. 22, the device driver 371 includes a plurality of routines 
including a color blending routine 2202 and a set of response correction routines 
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2204. The response correction routines 2204 included a gamma correction sub- 
routine 2206, a viewing angle correction sub-routine 2208 and an additional response 
correction sub-routine 22 1 0. 

The device driver 371 receives as its input the bit mapped images and other 
information, e.g., foreground&ackground color information, from the GDI 302. It 
also receives display device profile information, e.g., the information in DDP 348, for 
the display device being used. User profile information, e.g., UPI 354, for the user 
who is logged into the computer system, is also supplied to the device driver 371. 
The device driver also receives measured values, e.g., ambient light intensity 
information, from measuring device 106. The various input signals and information 
may be used by any one of the routines or sub-routines included in the device driver 
371 . The device driver 371 outputs the DDI/UPI information input thereto to the GDI 
for use by the GDI. The device driver also generates and outputs, to the display 
adapter 248, sets of luminous intensity values representing bitmapped images. 

Color blending routine 2202 is responsible for applying foreground and 
background color selections to the data output by the GDI in LCD embodiments 
where the GDI generates bitmapped images represented by pixel sub-component 
blend coefficients, e.g., alpha values. Operation of the color blending routine 2202 
will be described in the context of a system wherein one alpha value is generated per 
pixel sub-component. 

Color blending routine 2202 first normalizes input alpha values, otR, aG, aB, 
to a range of 0-1. Foreground and background color selections, as indicated by 
foreground and background pixel sub-component luminous intensity values (Rf, Gf, 
Bf), (Rb, Gb, Bb) of a foreground and a background colored pixel, respectively, are 
then applied to generate output pixel sub-component luminous intensity values as 
follows: 

R = (Rf<xr) + Rb(1-<xr) 

G = (Gf<xg) + Gb(I-Og) 

B = (B F a B ) + Bb(I-ob). 

The values R, G, B represent the RGB pixel sub-component luminous 
intensity values corresponding to a pixel, generated by color blending routine 2202. 

Response correction routines 2204 receive the R, G, B pixel sub-component 
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luminous intensity values output by color blending routine 2202 or the GDI 302, in 
embodiments where the GDI generates luminous intensity values as opposed to alpha 
values. 

Unfortunately, due to a variety of factors the light output characteristics of a 
5 monitor tend to be non-linear and may vary widely from device to device due to age, 
manufacturing difference and a host of other factors. Complicating matters further is 
the fact that the position of the viewer relative to the screen can have in impact on the 
amount of light the viewer will perceive from different portions of the screen. 

The luminous intensity values supplied to the response correction routines 
10 2204 reflect desired output pixel sub-component luminous intensity values assuming a 
linear output (display) device. It is the responsibility of the response correction 
routines to compensate for the non-linear response characteristics of the actual display 
device. Thus, the purpose of the routines 2204 is to insure that the actual display 
output approximates the desired pixel sub-component luminous intensity levels 
15 indicated by the pixel sub-component luminous intensity values output by the GDI or 
color blending routine 2202. 

Gamma correction is one technique for correcting luminous intensity values to 
take into consideration display device light output characteristics. Gamma correction 
sub-routine 2206 implements a gamma correction operation. If input on a user 
20 preferred gamma value is available, e.g., from the user profile information 354, the 

user preferred gamma value is used by sub-routine 2206. Alternatively, the gamma 
value stored in the display device profile 348, associated with the output display 
device 254, is used. 

In accordance with the present invention, different gamma values may, and 
25 normally will, be used for LCD and CRT displays. In addition, different gamma 
values may be used for different LCD displays which are of the same model type and 
which are manufactured by the same display manufacturer. 

As part of the gamma correction operation, the red, green and blue pixel sub- 
component luminous intensity values are normalized to a value between 0 and 1 to 
30 produce normalized, red, green and blue pixel sub-component luminous intensity 
levels Rn, Gn, B n . They are then processed according to the following equation: 
R N c = RN 1/y 
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Gnc ~ Gu l/y 
Bnc = BN 1/y 

The normalized, corrected R, G, B pixel sub-component luminous intensity 
values, Rnc, Gnc, Bnc, respectively, are than converted back to luminous intensity 
5 values between the range of 0 and 255 by the gamma correction sub-routine and 
output to the viewing angle correction sub-routine 2208. 

Viewing angle correction sub-routine 2208 uses viewing position information 
included in the user profile 348 to adjust luminous intensity values. As with the case 
of gamma correction, the processing performed by the viewing angle correction sub- 
10 routine is designed to adjust pixel sub-component luminous intensity values so that 
the perceived luminous intensity will approximate that specified by the pixel sub- 
component luminous intensity values output by the GDI 302 or color blending routine 
2202. 

The additional response correction sub-routine 2210 uses display device 
15 profile information such as the device's white point, gamut and/or method of light 
modulation and/or measured values such as ambient light intensity, to further adjust 
the pixel sub-component luminous intensity level values output by sub-routine 2208 
so that that the perceived luminous intensity will approximate that specified by the 
pixel sub-component luminous intensity values output by the GDI 302 or color 
20 blending routine 2202. The additional response correction sub-routine may 
compensate for, e.g., degradation in the ability of a CRT display to output light as it 
ages. 

The corrected pixel sub-component luminous intensity values generated by the 
additional response correction sub-routine 2210 are output to the display adapter 248. 
25 The display adapter 248 processes the received pixel sub-component luminous 

intensity values to put them in a format used to control the display device 10 

254. In response to luminous intensity control signals received from the 
display adapter 248, the display device 254 displays the images, e.g., text, being 
rendered. 

30 Through the use of the above discussed response correction routines, the 

output of the display device 254 can be adjusted so that the perceived images are of a 
higher quality than is possible in embodiments where such response correction 
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operations are not performed. 

In view of the description of the invention included herein, numerous 
additional embodiments and variations on the discussed embodiments of the present 
invention will be apparent to one of ordinary skill in the art. It is to be understood 
that such embodiments do not depart from the present invention and are to be 
considered within the scope of the invention. 
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CLAIM 

1 . A display method, comprising the steps of: 

storing information about at least one attribute associated with a display 
device; and 

using the stored attribute information when processing a representation of an 
5 image to be displayed on said display device. 

2. The display method of claim 1, wherein the step of storing at least one 
attribute associated with a display device includes the act of: 

storing display type information, the display type information indicating 
whether the display is a liquid crystal display, a cathode ray tube display or another 
10 type of display. 

3. The display method of claim 2, wherein the image is a character image 
and wherein said step of using the stored attribute information includes the step of: 

scaling the representation of the character image as a function of the display 
type information. 

15 "4. The display method of claim 3, wherein said act of scaling the 

representation of the character image includes the act of: 

selecting, based on the display type information, which one of a plurality of 

scaling methods should be used to scale the representation of the character image, the 

representation of the character image being scaled differently when the display type 
20 information indicates a liquid crystal display than when the display type information 

indicates a cathode ray tube display. 

5. The display method of claim 1, wherein the step of storing information 
about at least one attribute associated with a display device includes the act of: 

storing information about two attributes associated with the display device 
25 selected from the group of display attribute information consisting of: display type 
information, resolution information, pixel pattern information, light emitter shape 
information and method of light modulation information. 

6. The display method of claim 5, wherein said step of using the stored 
attribute information includes the act of: 

30 scaling the representation of the character image as a function of the stored 

information about the at least two attributes. 
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7. The display method of claim 6, wherein said step of using the stored 
attribute information further includes the act of: 

performing a scan conversion operation as a function of the stored information 
about at least one of the two attributes. 
5 8. The display method of claim 6, wherein said step of using the stored 

attribute information further includes the act of: 

performing a hinting operation as a function of the stored information about at 
least one of the two attributes. 

9. The display method of claim 1, wherein the step of storing information 
10 about at least one attribute associated with a display device includes the act of: 

storing information about an attribute associated with the display device from 
the group of attribute information consisting of gamma information, gamut 
information and white point information. 

10. The display method of claim 9, wherein the step of storing information 
1 5 about at least one attribute associated with a display device further includes the act of: 

storing information about an attribute associated with the display device from 
the group of display attributes consisting of: display type information, resolution 
information, pixel pattern information, light emitter shape information and method of 
light modulation information. 
20 11. The method of claim 10, further comprising the step of periodically 

updating said stored attribute information, which includes the acts of: 

estimating a change in a value included in said stored attribute information 
corresponding to estimated physical change in at least one display device attribute; 
and 

25 modifying the stored attribute information as a function of the estimated 

change in value. 

12. The method of claim 10, further comprising the step of periodically 
updating said stored attribute information, which includes the acts of: 

periodically measuring said attribute associated with the display device; and 
30 modifying at least some of the stored attribute information so that it includes 

the most recently measured attribute information. 
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13. The method of claim 1, wherein the step of storing information about 
at least one attribute associated with a display device further comprises the steps of: 

storing a user display preference setting selected from the group of display 
preference settings consisting of a gamma value preference setting, a user viewing 
5 position preference setting, and a resolution vs. color accuracy preference setting, 
wherein the at least one attribute is the user display preference setting; and 

using the stored user display preference setting when processing the 
representation of the image to be displayed on said display device. 

14. The method of claim 11, wherein the step of storing the user display 
1 0 preference setting comprises the steps of: 

displaying a user controllable slider that can be used to select the user display 
preference setting; and 

receiving user input that manipulates the slider and thereby selects the user 
display preference setting. 
15 15. The method of claim 1, further comprising the step of: 

storing information about a user gamma value preference; and 

performing a gamma value correction operation on the data representing the 
image to be displayed using the stored user gamma value preference information. 

16. The method of claim 1, further comprising the step of: 
20 storing information about a user's ability to perceive color; and 

performing a color filtering operation on the data representing the image to be 
displayed using said stored information about a user's ability to perceive color. 

17. The method of claim 1, further comprising the step of: 
storing information about a preferred viewing position of a user; and 

25 performing a display response correction operation on the representation of the 

image as a function of the stored information about a preferred viewing position. 

18. The method of claim 17, wherein the stored information about a 
preferred viewing position includes at least one of viewing angle and viewing distance 
information. 

30 1 9. A computer readable medium comprising: 

computer executable instructions for controlling a computer to perform the 
steps recited in claim 1. 
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20. A method of using a display device, comprising the steps of: 
determining at least one light output characteristic of said display device; 
storing display device light output characteristic information for said display 

device using a digital recording media; and 
5 supplying the stored light output characteristic information to a computer 

system coupled to said display device. 

21. The method of claim 20, wherein said light output characteristic of said 
display device includes at least one of the output characteristics from the group 
consisting of gamut, white point and gamma characteristics. 

10 22. The method of claim 21, wherein the step of determining at least one 

light output characteristic includes the act of: 

using a measuring device to measure said light output characteristic of said 
display device. 

23. The method of claim 22, further comprising the step of: 

15 storing physical display device attribute information using said digital 

recording media, the pixel pattern information including at least one of the physical 
display device attributes from the group consisting of display type, pixel pattern, 
resolution, display element shape and date of manufacture. 

24. The method of claim 23, wherein said digital recording media is a 
20 magnetic disk; and wherein the step of storing physical display device attribute 

information includes the step of storing said display device attribute information on 
the magnetic disk. 

25. The method of claim 23, wherein said digital recording media is non- 
volatile memory; and 

25 wherein the step of storing physical display device attribute information 

includes the step of storing said display device attribute information in the non- 
volatile memory. 

26. The method of claim 22, further comprising the steps of: 
periodically measuring said light output characteristic of said display device; 

30 and 

updating the stored information with said periodic light characteristic 
measurement. 
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27. The method of claim 22, further comprising the step of: 
using said measuring device to measure ambient light conditions. 

28. The method of claim 27, further comprising the steps of: 

estimating a change in said at least one output characteristic as a function of 
time; and 

updating said stored display device light output characteristic information as a 
function the estimated change in said at least one output characteristic. 

29. The method of claim 28, further comprising the step of: 

using the stored display device light output characteristic information to 
perform an image processing operation; and 

displaying an image resulting from said image processing operation on said 
display device. 

30. A method of operating a computer system, comprising the steps of: 
receiving display device data including information about physical 

characteristics of a display device; 

performing an image processing operation as a function of the received 
display device data to generate data representing an image to be displayed; and 

displaying the image represented by the generated data on said display device. 

31. The method of claim 30, wherein the received display device data 
includes display type information. 

32. The method of claim 30, wherein the received display device data 
includes pixel pattern information. 

33. The method of claim 30, wherein the received display device data 
includes display device gamma value information. 

34. The method of claim 30, wherein the received display device data 
includes white point information. 

35. The method of claim 30, wherein the received display device data 
includes display device date of manufacture information. 

36. The method of claim 30, wherein the received display device data 
includes at least two items of information from the group of information items 
consisting of: 

display type information, pixel pattern information, display device gamma 
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value information, white point information and display device date of manufacture 
information. 

37. The method of claim 30, wherein the received display device data 
includes at least three items of information from the group of information items 

5 consisting of: 

display type information, pixel pattern information, display device gamma 
value information, white point information, resolution information, and display device 
date of manufacture information. 

38. The method of claim 37, wherein the step of performing an image 
10 processing operation as a function of the received display device data is performed as 

a function of the at least three items of information included in the received display 
device data. 

39. A machine readable media, comprising: 

a set of display device profile information including at least two items of 
15 information from the group of information items consisting of: 

display type information, pixel pattern information, display device gamma 
value information, white point information, resolution information, and display device 
date of manufacture information. 

40. The machine readable media of claim 39, further comprising: 

20 an additional one of said items of information from the group of information 

items consisting of: 

display type information, pixel pattern information, display device gamma 
value information, white point information, resolution information, and display device 
date of manufacture information, for a total of at least three information items from 
25 said group. 

4 1 . The machine readable media of claim 39, further comprising: 

a user profile including user viewing preference information including at least 
one information item from the group of user preference information items consisting 
of: 

30 gamma value preference information and user viewing position 

preference information. 
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42. A display device, comprising: 
a display screen; and 

a data storage device including a set of display device profile information 
including at least one item of information from the group of information items 
5 consisting of display type information, pixel pattern information, display device 
gamma value information, white point information, resolution information, and 
display device date of manufacture information. 

43. The display device of claim 42, wherein said set of display device 
profile information includes a total of at least two information items from said group 

10 of information items consisting of: display type information, pixel pattern 

information, display device gamma value information, white point information, 
resolution information, and display device date of manufacture information. 

44. The display device of claim 43, further comprising, means for 
communicating the display device profile information to a computer system coupled 

15 to the display device and for receiving image data to be displayed on the screen of 
said display device. 

45. The display device of claim 44, wherein the means for communicating 
the display device profile information and for receiving image data is an input/output 
interface. 

20 46. A computer system, comprising: 

a display device; 

a memory device, the memory device including a set of display device profile 
information including at least two items of information from the group of information 
items consisting of: display type information, pixel pattern information, display 
25 device gamma value information, white point information, resolution information, and 
display device date of manufacture information; and 

means for rendering images as a function of the information included in the set 
of display device profile information. 

47. The computer system, of claim 46, wherein the memory device further 
30 comprises: 

a user profile including user viewing preference information including at least 
one information item from the group of user preference information items consisting 
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of a gamma value preference setting, a user viewing position preference setting, and a 
resolution vs. color accuracy preference setting. 

48. The computer system of claim 46, wherein the means for rendering 
images also operates as a function of the information included in the user profile. 

49. A method of controlling a display device, comprising: 
detecting ambient light conditions in the vicinity of the display device; and 
adjusting the light output of the display device as a function of the detected 

ambient light conditions. 

50. The method of claim 49, wherein the step of detecting ambient light 
conditions, includes the step of: 

using a light sensing device mounted in the proximity of the display device to 
sense ambient light conditions. 

5 1 . The method of claim 50, further comprising the step of: 
measuring a light output characteristic of the display device; and 

using the light output characteristic of the display device, in conjunction with 
detected a ambient light condition information, to control the light output of said 
display device. 
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Republic of Korea 


PT 


Portugal 






cu 


Cuba 


KZ 


KazaJcstan 


RO 


Romania 






cz 


Czech Republic 


LC 


Saint Lucia 


RU 


Russian Federation 






DE 


Germany 


U 


Liechtenstein 


SD 


Sudan 






DK 


Denmark 


LK 


Sri Lanka 


SE 


Sweden 






EE 


Estonia 


LR 


Liberia 


SG 


Singapore 







